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VAGUENESS  AND  DECISION:  A  REJOINDER 


Daniel  Ellsberg^ 

The  RAND  Corporation,  Santa  Monica,  California 

There  Is  so  much  In  these  matters  on  which  Professor  Roberts  and 
I  agree  that.  If  a  few  sunmary  sentences  were  sll^tly  different,  I 
would  be  tengpted  simply  to  thank  him  for  supplementing  my  earlier 
dlsciisslon  and  underlining  certain  aspects  of  It.  But  that  wo\ild  be 
rather  tactlessly  to  Ignore  Roberts'  own  interpretation  of  his  remarks, 
which  seems  qvilte  otherwise.  If  I  am  to  take  issue  with  him.  It  must 
be  not  with  his  treatment  of  my  position  —  as  criticism,  his  comments 
are  admirably  restradned,  fair-minded  and  cautious  —  but  with  his 
understanding  of  the  thrust  of  his  own  specific  comments. 

A  major  point  on  which  there  seems  no  disagreement  is  the  fact 
and  the  general  pattern  of  violations  of  the  Savage  axioms  in  connec¬ 
tion  with  my  hypothetical  choice -problems.  Of  course.  In  testing  the 
acceptability  of  normative  postulates,  hasty,  luidellberated  choices 
are  In  no  way  conclusive  and  violation  must  be  considered  tentative^ 
pending  thorou^^  analysis  and  reflection  In  the  light  of  ed.1 

Any  views  expressed  In  this  paper  are  those  of  the  author.  They 
should  not  be  Interpreted  as  reflecting  the  views  of  The  RAND  Corpora¬ 
tion  or  the  official  opinion  or  policy  of  any  of  its  governmental  or 
private  research  sponsors.  Papers  are  reproduced  by  The  RAND  Corporation 
as  a  courtesy  to  members  of  its  staff. 

This  paper  Is  to  sqjpear  in  the  Quarterly  Journal  of  Economics, 

May  1963. 

^Likewise  confoimity,  \rtiere  the  appropriateness  of  the  theory  Is 
In  question. 
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intpllcations  of  the  theory.^  "I  do  not  contend,"  Roberts  conclxides, 

"that  all  subjects  would  hold  to  the  Savage  axioms  as  a  result  of  such 
analysis,  but  I  believe,  partly  on  the  basis  of  Infonnal  experimentation, 
that  many  of  them  would.”  That  conclusion  could  sunmarlze  my  own  obser¬ 
vations,  though  I  might  reverse  the  eoq^hasls.  As  I  reported  in  my 
2 

article,  responses  do  vary.  Of  those  who  tentatively  violate  the  postu¬ 
lates,  some  conclude  upon  reflection  and/or  interrogation  by  unsynqpathetlc 
critics  (sometimes,  themselves)  that  their  initial  choices  were  "mistakes" 
which  they  now  wish  to  modify;  others  do  not.  For  further  reference,  I 
shall  call  the  former  group  "transient"  violators  and  the  latter, 
"deliberate"  violators.-'  Roberts*  introspective  experience  with  his  own 
violations  places  him,  so  far,  in  the  first  category;  I  remain,  so  far, 
in  the  second.  But  though  our  own  recuztlons  fall  to  match,  I  gather  that 
our  observations  of  response  varieties  have  been  similar.  Our  notions  of 
the  relative  frequency  of  "deliberate"  violation  may  differ  somewhat,  and 
Roberts  is  more  concerned  to  lower  it,  if  possible.  But  be  does  not  claim 


^See  "Risk,  Ambiguity,  and  the  Savage  Axioms,”  Quarterly  Journal  of 
Economics,  November  1961,  pp.  655-656,  for  comments  and  admonitions 
parallel!^  Roberts'.  For  a  much  fuller  discussion  of  the  nature,  valida¬ 
tion  and  functions  of  normative  theories  of  choice,  see  "Risk,  Ambiguity 
ani  Decision,'  The  RAND  Corporation,  RM-35^3  (forthcoming);  again,  I 
think  we  are  in  conplete  agreement  on  these  questions. 

^Ibld. 

^his  distinction  can  be  made  hollow,  to  whatever  end  that  serves,  by 
taking  the  period  of  "adequate"  reflection  to  be  sufficiently  short  of 
sufficiently  long.  For  practical  purposes,  those  violators  who  conclude 
that  they  wish  to  persist  in  their  violating  choices  after  conscientious 
consideration  of  such  critiques  as  those  of  Roberts  and  of  H.  Raiffa 
("Risk,  Ambiguity,  and  the  Savage  Axioms:  Cooment, "  Quarterly  Journal  of 
Economics  [Vol.  IXXV,  I961],  pp.  690-69!*)  may  be  classed  as  ''deliberate." 
Although  such  persons  may  always  change  their  minds  eventually,  the  Savage 
axioms  do  not  constitute  an  appropriate,  usable  model  of  their  actual, 
deliberated  preferences  now;  if  they  are  to  benefit  from  a  normative  logic 
of  choice,  it  must  be  somewhat  different. 
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that  the  violations  of  his  subjects  have  all  so  far,  like  his  own,  proved 
transient  (I  presume  he  would  not  fail  to  mention  it  if  they  had)  nor  does 
he  conJect\ire  that  with  adequate  reflection  by  all  concerned  the  class  of 
deliberate  violators  will  prove  empty.  It  is  only  this  residual  group  of 
deliberate  violators  that  raise  problems  of  normative  theory,  and  my 
"diagnosis"  (that  "ambiguity"  was  a  major  contributing  factor)  concerned 
them  exclusively. 

Roberts  defines  "vagueness"  in  terms  that  correspond  to  my  notions 

of  "ambiguity"  veil  enou^  for  this  particular  discussion: 

A  person  is  vague  about  the  probability  assigned  to  a 
single  trial  if  he  cannot  obtain  from  himself  a  clear 
aasver  sis  to  what  probaiblllty  to  assign  to  it.  He  is 
vague  about  a  probability  distribution  if  introspection 
fsdJ.8  to  reveal  clearly  what  the  distribution  is... we 
are  always  more  or  less  vague. ^ 


^Thoxi^  Roberts  furnishes  no  formal  model  for  this  state  of  mind,  his 
definition  Inmedlately  suggests  one:  the  whole  set  of  probability  distribu¬ 
tions  that  are  not  ruled  out  by  those  probability  coopsurlsons  of  which  the 
individual  feels  relatively  "sure."  This  assumes  that  introspection  does 
reveal  a  relatively  clear  answer  with  respect  to  some  probability  ccaiparl- 
sons;  typically,  these  Judgaents  are  in  the  form  of  inequalities,  statements 
that  the  probability  of  one  event  is  greater  (or,  not  less)  than  that  of 
another.  To  say  that  "we  are  always  more  or  less  vague"  nay  be  interpreted 
to  mean  that  the  set  of  probability  distributions  conqpatlble  with  (not 
excluded  by)  all  o\ir  definite  probability  Judsnents  at  a  given  moment 
typically  contains  more  than  one  mesiber.  In  general,  this  model  would 
associate  a  particular  event  not  with  a  precise  probability  but  with  an 
interval  of  probabillty-nunibers  circianscribed  by  Inequalities,  and  the 
relation  "not  less  probable  than"  is  regarded  as  providing  only  a  partial 
ordering  among  events. 

The  distribution-set  is  denoted  Y°  in  "Risk,  Ambiguity,  and  the  Savage 
Axioms"  (p.  661).  At  the  time  of  writing  that  article,  I  was  unaware  that 
this  model  of  opinion,  encoapaasing  "vague"  opinion  and  "ambiguity,"  had 
been  elaborately  developed  in  earlier,  inportant  works  by  B.  0.  Koopman 
("The  Axioms  and  Algebra  of  Int\iltlve  Probability,"  Aimals  of  Mathematics. 
Ser.  2,  Vol.  4l,  19l»0,  pp.  269-292)  and  I.  J.  Good  ("Rational  Decisions,^' 
Journal  of  the  Royal  StatisticsLl  Society,  Ser.  B,  Vol.  l4,  1952,  pp.  107- 
ll4;  more  recently,  '^Subjective  Probability  as  the  Measure  of  a  Non- 
Measurable  Set,"  Proceedings  of  the  International  Congress  for  Logic, 
Methodolo^  and  Philosophy  of  Science,  Stanford,  19627  PP«  319-329) ♦  These 
works  are  further  discuss^  in  "Risk,  Ambiguity  and  Decision." 


I  presume  that  Roberts  agrees  that  my  hypothetical  exan^les  tend  to 
Induce  considerable  vagueness  of  opinion  concerning  certain  alternatives 
(his  subjects  would  tell  him.  If  his  own  Introspection  did  not).^  More¬ 
over,  Roberts  enQ>haslzes  that  the  problem  of  vagueness  Is  "reeil  and 
Important."  What  he  denies  Is  that  the  evident  vagueness  of  opinion  In 

these  Instances  contributes  In  any  Important  way  to  the  violations  of 

2 

the  Savage  postulates  that  admittedly  do  occur. 


^In  the  specific  exanple  he  discusses,  the  subjects  are  given  no 
explicit  Infonaatlon  on  the  ratio  of  red  to  black  balls  In  Um  I;  In 
practice,  subjects  readily  report  great  vagueness  of  opinion  concerning 
their  prospects  of  winning  bets  on  the  color  of  a  ball  to  be  drawn  frcn 
Um  1  (bets  on  Red^  or  Blacky),  in  contrast  to  their  precise  opinions  on 

the  probabilities  of  winning  corresponding  bets  on  Um  II,  In  which  the 
proi)ortlon  of  red  to  black  Is  known  to  be  ^0:^0.  In  tenos  of  the  model  In 
the  preceding  footnote,  the  opinion  of  such  a  subject  concerning  a  drawing 
from  Um  I  (or,  concerning  the  ratio  of  red  to  black  In  Um  I:  an  uncer¬ 
tain  fact  on  which  the  prize  does  not  depend  directly  but  which  imderlles 
the  subject's  evaluation  of  the  bet)  must  be  represented  by  a  large  set  of 
distributions,  while  his  opinion  concerning  a  drawing  frcm  Um  II  may  be 
represented  by  a  sin^e,  precise  distribution. 

then.  Is  It  "important"?  How  does  vagueness  affect  decision? 

1  believe  that  Roberts  would  aiuwer:  It  affects  the  difficulty  of  decision¬ 
making,  the  time  and  effort  required,  the  pleasantness  of  the  task  and  one's 
confidence  or  uneasiness  In  the  results,  the  frequency  of  random  errors  and 
"brief"  transient  violations;  but  not,  given  enou^  time  for  reflection 
and  analysis,  the  answers  one  will  ultimately  choose,  hence  not  the 
acceptability  of  Savage's  nonnative  postulates.  In  short,  vagueness  of 
opinions  affects  "feelings"  mom  than  decisions,  promotes  indecisiveness 
and  vacillation,  and  affects  decision-making  in  the  same  sorts  of  ways  as 
does  complexity. 

My  own  view  is  that  In  addition  to  these  effects,  and  partly  because 
of  them,  vagueness  of  opinion  can  affect  the  choices  that  seem  preferable 
on  thorough  reflection,  and  for  some  people  Its  Influence  does  lead  to 
deliberate  conflicts  with  the  Savage  postulates.  Vagueness  need  not  be 
synonymous  with  Indecision,  as  Roberts  Implies;  some  choices  are  easy. 

Just  because  certain  opinions  are  vague  (for  many  people  this  is  true  for 
the  choice  between  a  bet  on  Red^  and  a  bet  on  l*e.,  for  questions 

3  and  U  cited  by  Roberts).  Ror  must  such  people  turn  to  informal  aneilysis, 
if  a  more  appropriate  foimel  theory  can  be  made  available.  I  think  It  can. 

I  proposed  one  candidate  In  my  article  and  discuss  several  others.  In¬ 
cluding  some  I  wovLLd  favor  (omitted,  regrettably,  from  the  article  for 
reasons  of  speu:e)  in  "Risk,  Ambiguity  and  Decision.”  Most  of  this  "therapy' 
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He  concliides:  '  It  Is  hard  to  see  any  Inqportant  role  for  vagueness 
in  Ellsberg's  paradox,  at  least  for  a  person  who  makes  definite  choices 
for  all  four  questions."  The  challenge  seems  clear  enough.  But  on  a 
closer  look,  the  conflict  bliirs. 

The  heart  of  Roberts'  specific  critique  is  a  list  of  considerations 
that  could  Induce  a  subject  to  make  choices  in  the  "tvo-um  example”  cited 
above  in  a  i>attem  that  evidently  violates  the  Savage  postulates:  si>ecifl- 
cally.  Postulate  2,  the  Siu^-Thlng  Principle.  These  considerations  Incliade 
I>osslble  mistaken  beliefs  as  to  the  explicit  conditions  of  the  bets:  for 
exaoq>le,  the  facts  that  the  game  is  to  be  played  only  once,  that  a  single 
drawing  is  to  be  made  from  the  selected  um,  and  that  the  money  payoff 
depends  only  on  the  color  of  the  ball  drawn,  not  on  the  proportion  of  colors 
in  the  um. 

Roberts'  discussion  both  before  and  after  this  list  is  presented  tends 
to  suggest  that  all  the  considerations  to  be  mentioned  are  of  the  character 
of  the  three  above:  "mistakes,  misinterpretations,  misconceptions"  that 
may  "coztfuse"  a  subject  but  which,  once  brou^d^t  into  conscioiisness  and  made 
e^^licit,  will  not  Induce  him  to  persist  in  violations  when  the  problem  is 
prc^rly  understood.  Horeover,  his  conclusion  implies  that  vagueness  plays 
no  part  in  these  considerations. 

But,  neither  of  these  characterizations  of  the  proposed  rationales 
seems  accurate;  and  even  if  they  were,  Roberts'  argument  would  not  sxistain 
his  conclusion. 

The  first  characterization,  if  valid,  would  lii5>ly  that  he  has  sinply 

was  antedated  by  I.  J.  Good  in  his  remarkable  pcper,  "Rational  Decisions" 
(cited  above).  For  a  recent  i>arallel,  see  C.  A.  B.  Smith,  'Consistency  in 
Statistical  Inference  and  Decision,"  Joynal  of  the  Royal  Statistical 
Society,  Ser.  B,  Vol.  23,  I96I,  pp.  1-^. 
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compiled  a  list  of  various  sources  of  transient  violations:  an  Interest* 

Ing  and  useful  effort,  but  not  addressed  to  ^  problem.  Used  In  self- 
interrogation,  such  a  list  (in  which  vagueness  would  surely  be  but  one 
factor  among  many)  would  be  helpful  In  slftlhg  out  the  transient  from  the 
deliberate  violators  more  efficiently.  But  unless  one  conjectured  that 
such  a  sieve  would.  In  practice,  show  the  latter,  residual  class  to  be 
null  --  and  Roberts  does  not  press  his  argument  this  far  —  It  would 
seem  to  provide,  at  best.  Imperfect  Insist  Into  the  "paradox"  (in  Roberts' 
eyes)  of  persistent,  deliberate  violation. 

What  are  the  considerations.  In  Roberts '  view,  that  influence  the 
deliberate  violator,  he  whose  transgressions  of  the  Savage  postulates 
must  be  adjudged  neither  ll^thearted,  irresponsible  nor  iinwlse?  Roberts 
does  not  dispute  his  existence,  yet  he  ventures  no  explanation;  nor  does 
he  directly  attack  the  one  I  propose.  In  fact,  he  seems  to  be  silent  on 
the  matter.  But  this  Is  the  precise  point  at  issiie.  If  my  "diagnosis”  — 
which  concerned  only  these  residual  subjects  —  is  In  g:uestloni 

The  assertion  that  the  diagnosis  of  vagueness  has  been  shown  to  be 
"wrong"  or  Irrelevemt  appears  even  more  ptizzling  when  one  considers  the  actual 
substance  of  the  points  Roberts  raises  In  his  critique.  In  the  six  numbered 
passages  and  two  of  the  footnotes  (9  and  13)  toward  the  end  of  Section  III, 

I  count  nine  distinct  "resolutions"  of  the  pattern  of  vlolatloxis  In  question. 
In  six  of  these.  Implicitly  or  ejqplicitly,  vagueness  seems  to  play  a  criti¬ 
cal  rolei  I  shall  comnent  on  the  more  Impox^ant  of  these  (the  reader  Is 
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ref erred  to  Roberts'  text  for  the  exact  liiq>ort  of  the  propositions  cited): 

(a)  "The  subject  nay  have  had  a  mush  harder  time  in  answering  ques> 
tlon  1  than  question  2."  Really?  VHiy?  except  that  he  finds  his  opinions 
more  vstgue,  with  respect  to  question  1!  (Question  1  concerns  a  drawing 
from  Um  1,  for  which  the  ratio  of  red  to  black  has  not  been  specified.) 

Why  else  would  he  "certainly  not  have  an  easy  mind"  about  any  given  reso¬ 
lution  of  the  question;  why  else  ml^t  he  expect  himself  to  be  "wildly 
volatile  in  his  choices"  if  he  had  to  make  the  assessment  repeatedly? 

(Either  of  these  expectations  could  serve  as  a  fairly  adequate  working 
definition  of  "vagueness"  of  opinion;  but  here  and  below,  I  rely  on 
Roberts'  definition  cited  earlier.)  As  Roberts  suggests,  "it  is  easy  to 
carry  over  this  feeling"  into  a  preference  for  bets  based  on  Um  II  (in 
which  the  ratio  is  known  to  be  precisely  ^0:^0).  But  this  is  a  response 
to  relative  vagueness  I  And  by  the  way  ...  in  what  sense  does  it  reflect 
"mistakes,"  confusions,  misinterpretation  of  the  problem?  Can,  or  should, 
cm  application  of  the  Savage  postulates  abstract  from  such  "difficulties," 
that  issue  from  the  very  quality  of  the  uncertainties  in  question? 

(b)  "The  subject  may  realize  he  is  vague,  in  Savage's  sense,  about 
the  distribution"  of  the  ratio  of  Red  to  Black  in  Ura  I,  and  fail  "to 
realize  that  this  distribution  is  irrelevant  to  either  question  3  or  4." 

But  vagueness  about  the  distribution  is  not  conducive  to  precision  or 
confidence  about  its  mathematical  expectation,  which  ^  relevant  to  questions 
3  and  4.  Roberts  mentions  earlier  that  "the  answer  given  by  the  subject  to 
question  1  suggests  that,  for  him,"  this  expectation  -  but  the  other 
answers  postulated  for  him,  to  questions  3  4,  are  inconsistent  with 

this  interpretation,  as  they  are  with  the  inference  of  a  single,  definite 
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probablllty  distribution  over  the  possible  ratios.  As  Roberts  says,  the 
subject  "could”  claim  a  precise  opinion  on  the  expectation  despite  vagueness 
as  to  the  distribution  (somewhat  Implausibly,  unless  he  avows  conqpelllng 
Intuitions  of  symmetry  that  are  not  obviously  appropriate  here);  but  he  need 
not  do  so,  merely  to  Justify  his  answer  to  question  1.^  In  any  case,  the 
role  of  vagueness  is  explicit  here,  whether  or  not  a  "mistake”  is  involved. 

(c)  Why  might  the  subject  "feel  that  his  choice  of  Red^  co\ild  lead  to 
ut^leasant  second  guesses  by  someone  who  observed  the  e^qperlnent"?  Why  ml^t 
he  be  criticized  "for  not  taking  an  eqpparently  'safe'  course  of  action  (Red^^) 
is  he  lost  by  taking  an  'unsafe'  one  (Red^)";  on  what  grounds  can  bets  on 
Red^  and  Bed^^  be  discriminated  by  a  potential  critic  save  relative  vague¬ 
ness  of  acconpcmylng  opinions?  Indeed,  on  what  other  basis  can  the  terms 
"safe"  and  "unsafe,"  cub  applied  here,  meaningfully  be  interpreted?  (The  very 
fact  that  these  terms  do  seem  apt  in  this  context  deserves  some  serious 
thought  from  Roberts;  these  examples  were  partly  constructed  Just  to  elicit 
such  notions  without  offering  a  basis  for  them  in  terms  of  the  range,  minimum 
payoff,  variance  or  expected  value  of  a  specified  distribution.)  E^ren  if,  as 
Roberts  postulates,  the  subject's  own  opinions  happen  to  be  precise,  it  is 
vagueness  —  in  this  case,  the  anticipated  perception  and  evaluation  of 
vagueness  by  others  —  that  deteznines  his  hypothesized  response. 

(d)  "In  the  same  vein,  the  subject  may  fear  that  Um  I  mlg^t  con¬ 
tribute  to  an  ulcer."  Quite:  but  why  Um  I?  Obviously,  because  he  sees 
the  vagueness  that  we  see,  and  that  he  might  expect  others  to  see.  Even 
if  we  abstracted,  experimentally,  from  the  problem  of  anticipated  second 

^he  set  of  distributions  zapresenting  bis  vague  opinions  concemlzzg 
Um  I  may  have  certain  symaetry  features  (by  containing  matched  pairs  of 
asynmetric  distributions)  that  account  for  his  indifference  between  bets 
on  Red^  and  Blacky ;  no  pzacise  "expectation"  need  attach  to  the  set. 
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gueases  by  others  by  keepiog  hla  choices  private,  ve  could  not  protect  him 
from  no  less  unpleasant  second-guessing  by  himself;  from  self-reproaches, 
from  regret  (in  a  familiar,  not  a  technical,  sense  that  would  repay  analysis) 
evoked  by  losses  on  Um  I,  for  reasons  intimately  associated  with  vagueness. 

Once  again,  cure  most  of  these  considerations  based  on  mistakes,  confu¬ 
sions,  misconceptions?  Is  the  subject  wrong  to  expect  the  epithet  "unsafe" 
to  be  attached  to  Red^  and  not  to  he  foolish  to  take  that 

into  account?  Is  the  ulcer-prone  individual  mistaken,  or  arbitrary,  to  see 
Um  I  as  the  more  threatening  to  him?  And  is  a  subject  likely  to  change  his 
choices  when  such  considerations  underlying  them  are  made  fully  e;q>liclt? 
Somewhat  ironically,  it  is  Jtrst  because  these  factors  do  not  reflect  misin¬ 
terpretations  that  they  msy,  after  all,  help  es^aln  some  deliberate 
violations . 

This  is  not  to  say  that  vagueness,  as  defined,  is  typically  the  sole 
factor  underlying  deliberate  choices  in  conflict  with  the  Savage  postulates, 
even  in  the  sltubstions  I  described,  or  that  such  choices  reflect  mainly  a 
slsple  aversion  to  vagueness  (thou^  my  article  may  have  given  those  lapres- 
slons).  Hy  own  thinking  has  moved  recently  toward  recognizing  the  Influence 
of  various  dimensions  of  the  decision  problem  under  uncertcdnty  that  are 
strongly  associated  with  vagueness  but  distinct  from  it;  several  of  Roberts' 
remsurks  are  highly  pertinent  eurd  stimulating  along  these  lines. 

Nevertheless,  as  I  indicated  at  the  outset,  the  careful  reader  of  Roberts' 
catalog  of  rationales  for  violation  of  the  postulates  may  well  find  his  appre~ 
elation  of  vagueness  as  a  contributing  factor  enhanced  rather  than  diminished. 
In  fact,  Roberts'  svmmary  remark,  "It  is  hsird  to  see  any  Inportant  role  for 
vagueness...,"  seems  to  me  to  make  a  distinctly  odd  impression  following 
Immediately,  as  it  does,  his  discussion  in  Section  III.  That  section  ends 
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vlth  a  vmmlng  vhlch  I  second,  but  which  also  sesaa  cogsnt  In  slightly 
paxagphxased  font:  Confondty  to  the  Sanrage  axlons  In  spite  of  vagueness 
should  not  be  contesplated  lle^heartedly  if  the  declsleos  or  inferences 
Imrolved  are  taken  seriously. 


